Some Information Theoretic Optimality Criteria for General Classification'
نویسنده
چکیده
Central to the various purposes for which general classification is practiced is the preservation, or summarizing, of information (Michener, 1963; Sneath, 1957; Sokal, 1962; Farris, 1967; Johnson, 1968; Rogers, 1961; Wirth, Estabrook, and Rogers, 1966). This discussion will present one method in which this fundamental concept can be made more precise and, within that context, suggest possible logical formulations for preservation or summarization of information.
منابع مشابه
Feature Selection Using Multi Objective Genetic Algorithm with Support Vector Machine
Different approaches have been proposed for feature selection to obtain suitable features subset among all features. These methods search feature space for feature subsets which satisfies some criteria or optimizes several objective functions. The objective functions are divided into two main groups: filter and wrapper methods. In filter methods, features subsets are selected due to some measu...
متن کاملInformation Theoretic Learning
of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy INFORMATION THEORETIC LEARNING: RENYI’S ENTROPY AND ITS APPLICATIONS TO ADAPTIVE SYSTEM TRAINING By Deniz Erdogmus May 2002 Chairman: Dr. Jose C. Principe Major Department: Electrical and Computer Engineering Traditionally, second-order ...
متن کاملOn Efficiency Criteria in Density Estimation
We discuss the classical efficiency criteria in density estimation and propose some variants. The context is a general density estimation scheme that contains the cases of i.i.d. or dependent random variables, in discrete or continuous time. Unbiased estimation, optimality and asymptotic optimality are considered. An example of a density estimator that satisfies some suggested criteria is given...
متن کاملInformation-Theoretic Bounded Rationality and ε-Optimality
Bounded rationality concerns the study of decision makers with limited information processing resources. Previously, the free energy difference functional has been suggested to model bounded rational decision making, as it provides a natural trade-off between an energy or utility function that is to be optimized and information processing costs that are measured by entropic search costs. The ma...
متن کاملA Review on the Evaluation Methods of Health Information Systems
Evaluation of health information systems is an effective approach to ensure the efficacy of the system which can lead to the improvement in quality of health care services. The main aims of evaluation are to identify the strength and efficiency of system in health care delivery, to identify the weaknesses of the system, and to suggest general recommendations for improving the performance of the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005